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Abstract 

This paper investigates the overload problem of a single congested router in 
TCP (Transmission Control Protocol) networks. To cope with the congestion phe- 
nomenon, we design a feedback control based on a multiple time-delays model of 
the set TCP/AQM (Active Queue Management). Indeed, using robust control tools, 
especially in the quadratic separation framework, the TCP/AQM model is rewrit- 
ten as an interconnected system and a structured state feedback is constructed to 
stabilize the network variables. Finally, we illustrate the proposed methodology 
with a numerical example and simulations using NS-2 [ 1 1 1 simulator. 

1 INTRODUCTION 

In IP networks, active queue management (AQM), embedded in router, reports to 
TCP sources its processing load. The objective is to manage the buffer utilization as 
well as the queueing delay. This has motivated a huge amount of work aiming at un- 
derstanding the congestion phenomenon and achieving better performances in terms of 
Quality of Service (QoS). As a matter of fact, there has been a growing recognition that 
the network itself must participate in congestion control and ressource management 

The AQM principle consists in dropping (or marking when ECN [34| option is en- 
abled) some packets before buffer saturates. Hence, following the Additive-Increase 
Multiplicative-Decrease (AIMD) behavior of TCP, sources reduce their congestion 
window size avoiding then the full saturation of the router. Basically, AQM support 
TCP for congestion avoidance and feedback to the latter when traffic is too heavy. In- 
deed, an AQM drops/marks incoming packet with a given probability related to a con- 
gestion index (such as queue length or delays) allowing then a kind of control on the 
buffer occupation at routers. Various mechanisms have been proposed in the network 
community for the development of AQM such as Random Early Detection (RED) lfl4l . 
Random Early Marking (REM) [ 2 ] , Adaptive Virtual Queue ( AVQ) J24l and many oth- 
ers ll35ll . Their performances have been evaluated 1131 . 11351 and empirical studies l26l 
have shown the effectiveness of these algorithms. 

As it has been highlighted in the litterature (see for example l27l . ifTTl and refer- 
ence therein), AQM acts as a controller supporting TCP for congestion control and can 
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be reformulated as a feedback control problem. Then, a significant research has been 
devoted to the use of control theory to develop more efficient AQM. Using dynamical 
model developed by |29|, some P (Proportional), PI (Proportional Integral) ifTTl have 
been designed. In the same framework, other tools have been used to extend this pre- 
liminary work such as a PID controller 11351 , lfl2l or robust control [ 33 1 . However, most 
of these papers do not take into account the delay and ensure the stability in closed loop 
for all delays which could be very conservative in practice. 

The study of congestion problem in time delay systems framework is not new and 
has been successfully exploited. Nevertheless, most of these works have been dedi- 
cated to the stability analysis of networks composed of homogeneous sources (see for 
example J25|, OTll . |9|, [28] and [37]). In this paper, networks with heterogeneous 
sources are considered introducing then several delays and increasing the model com- 
plexity. Regarding the AQM design problem, some works have already been done in 
ll2TI and 02). In 1161 . the construction of the AQM required to invoke the General- 
ized Nyquist Theorem and ETTl provides a delay dependent state feedback involving 
delay compensations with a memory feedback control. Or even in Q, delays are re- 
placed by a Pade approximation which is known to be not so accurate. All these latter 
methodologies are interesting in theory but sorely suitable in practice. While these 
latter studies have considered the simplified model of TCP/ AQM from 11291 , we use in 
this contribution a more accurate model presented in 11271 . Indeed, contrary to ETTl . 
[3 1 and [1611, both forward and backward delays are taken into account (that is, we do 
not neglect forward delays). Then, congestion control of networks consisting in het- 
erogeneous TCP sources is transformed into a stabilization problem for multiple time 
delays systems. Using a robust analysis framework and especially quadratic separation 
approach developed for time-delay systems by lfT31 . a stabilizing AQM is designed. 
The proposed control mechanism enables QoS in terms of RTT (Round Trip Time) and 
delay jitter which are relevant features for streaming and real-time applications over IP 
networks. Note that the approach employed in this paper allows the formulation of the 
problem into matrix inequalities [7 1 that provide systematic stability condition, easy to 
test. 

The paper is organized as follows. The second part presents the mathematical 
model of a network composed of a single router and several heterogeneous sources 
supporting TCP. Section III is dedicated to the design of the AQM ensuring the stabi- 
lization of TCP. Section IV presents a numerical example and simulation results using 
NS-2. 

2 NETWORK DYNAMICS 

In this paper, we consider a network consisting of a single router and N heterogeneous 
TCP sources. By heterogeneous, we mean that each source is linked to the router with 
different propagation times (see Figure [T]). Since the bottleneck is shared by N flows, 
TCP applies the congestion avoidance algorithm to cope with the network saturation 

ma. 

Deterministic fluid-flow models have been widely used (see 1271 . |29l , ll20ll and 
ll36l and references therein) to describe congestion control and AQM schemes in IP 
networks. These models capture the mean behavior of the TCP dynamic. While 
many studies dealing with network control in the automatic control theory framework 
consider the model proposed by (29J, we use in this paper the model introduced in 
ll27l and described by (Q~|). Contrary to the former, the model (Q]) takes into account 




Figure 1 : Network topology 




Figure 2: A single connection 



the forward and backward delays and does not make the simplifying assumption that 
(W(t - %)/W(t)){\ — p(t — T b )) = 1 (2TJ. The model and notations are as follow: 
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where Wi(t) is the congestion window size of the source i, b(t) is the queue length of 
the buffer at the router, T; is the round trip time (RTT) perceived by the source i. This 
latter quantity can be decomposed as the sum of the forward and backward delays (zf 
and ), standing for, respectively, the trip time from the source i to the router (the one 
way) and from the router to the source via the receiver (the return) (see Figure C, 
T Pi and are parameters related to the network configuration and represent, respec- 
tively, the link capacity, the propagation time of the path taken by the connection i and 
the number of TCP sources. 77, is the number of sessions established by source i. The 
signal pi(t) corresponds to the drop probability of a packet. 

In this paper, the objective is to develop a method which computes the appropriate 
dropping probability applied at the router in order to regulate the queue length of the 
buffer b(t) to a desired level (Figure[3). Since control depends on the system state, it is 
required to have access to them. However, congestion windows W, are not measurable. 
So that, we propose to reformulate the model ([]]) such that state vector can be measured. 
To this end, rates of each flow xu expressed as jc, (?) = will be considered. Hence, 




Figure 3: Network control 
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the dynamic of this new quantity is of the form i,(f) = ^ [iffij ~ 

Based on the expressions of W(t), b(t), T,(f) (see equation ([T])) and t(f) = ^U, a new 
model of the TCP behavior is derived 
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Remark 1 77!« model transformation allows us to use X{ instead ofWj which is more 
suitable to handle. Indeed, numerous works have developed tools that enable flow rates 
measurements, especially in anomaly detection framework (see for example j^jj, H22V ). 
Besides, The measure of the aggregate flow has already been proposed and successfully 
exploited in [24] and [21 / for the realization of the AVQ (Adaptive Virtual Queue) and 
a PID type AQM respectively. 

Our work focuses on the congestion control of a single router with a static topology 
(N and rjj are constant). Moreover, for the mathematical tractability, we make the 
usual assumption |27l . flTl . ETl that all delays (t,, zf and are time invariant when 
they appear as argument of a variable (for example x,(f — T,(f)) = X{(t — T,)). This 
latter assumption is valid as long as the queue length remains close to its equilibrium 
value and when the queueing delay is smaller than propagation delays. Defining an 
equilibrium point 

x 'o =T p + b /C 
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model (O can be linearized: 
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Figure 4: Implementation of an AQM 



where 5x, = X{ — xi g , 8b = b — bo and 8pi= pi — pi are the state variations around the 
equilibrium point (01. Matrices of the equation (@]i are defined by 
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a multiple time delays system (HJi is obtained with a particular form since each compo- 
nent of the state vector is delayed by a different quantity related to the communication 
path. Thus, in Section [3] an appropriate modeling of (01 with a structured form (in 
quadratic separation framework) is proposed in order to formulate the stability condi- 
tion. 

The problem of regulation is tackled in Section|3]with the design of a stabilizing 
state feedback for multiple time delays systems in order to guarantee a QoS. Hence, 
the dropping probability associated to source i will be computed at the router by 



Pi(t) = p i(l +ki8xi{t - x{ )+k 2 8b{t) 



(5) 



with k\, k 2 are components which have to be designed (see Figure @J. Note that the 
dropping probability p\ perceived by the source i will be delayed pi(t — rf ) because of 
the backward delay. Thus, a structured state feedback of the form © is proposed: 

• to avoid unnatural signals with different delay combinations in the state feed- 



back: 8xi (t 
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zf — Tj) for i, j £ {!,..., N} introducing then many additional 



• it provides light computations (with less operations) reducing then the processing 
time at router, 




Figure 5: An interconnected system 



• it provides a decentralized control if the dropping strategy is performed at end 
hosts when emulating AQM . 

Applying the structured state feedback type control law pi(t) to each source i, 
Mi S {1, . . . ,N}, the following interconnected system is obtained 
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where matrices gains K\ and K 2 are structured as /^i = diag{k\\, . . . ,k\tj} and Ki — 
diag{k 2i ,...,k 2N }. 

Equation (0 represents thus the mean behavior of TCP regulated by a structured 
state feedback type AQM around an equilibrium point. and K 2 can be derived from 
the stability analysis of the interconnection (O. To this end, we propose to design 
these latter gains by a suitable modeling of (O applying then the quadratic separation 
principle [32 1, [15] for the stability condition. 



3 STABILIZATION AND QoS GUARANTEE: DESIGN 
OF AN AQM 

The stability of the interconnected system © depends on matrices K\ and K 2 . This 
section aims to develop a method that provides such stabilizing matrices. Thus, the 
quadratic separation framework is considered and the following theorem will be em- 
ployed [32 1 . 

Theorem 1 Given two possibly non-squared matrices S, stf and an uncertain matrix 
V belonging to a set S. The uncertain system represented on Figure\5\is stable for all 
matrices VgE if and only if it exists a matrix = 0* satisfying conditions 

[ S -si ] X *0[ S -si ] X >0 (7) 

1 



[ 1 V* ]0 



< 0. (8) 



It is then required to transform the initial system © into a feedback system of the 
form of Figure|5]where a linear equation is connected to a linear uncertainty V. The key 
idea (proposed by [15] for the single time-delay systems case) consists in associating 
the delay operator as an uncertainty which must be bounded. Hence, Theorem Q] may 



be applied to the multiple time delays system © by rewritting it as an interconnected 
system (see Figure[5]l with $ = 1, 
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where 
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X(f) = [i' The delay matrix operators (0 represents T' , T or t) must be 

defined to create the delayed signals x xf , x T and b z '' (fTTT i. 

We aim at proving the stability (i.e. no poles in the right hand side of the complex 
plane for all values of the delay and for all values of the uncertainty VgS) which 
problem can be recast in the present framework as the well-posedness of the feedback 
system for all s S C + , for all values of the delays (T,, x{ and , i — {1 , . . . ,N}) and all 
admissible uncertainties VeS. Then a conservative choice of quadratic separator that 
fullfils © is of the form 



© = 















-p 








" 





-Q f 


























-Q b 


























-Q 














-p 






































Qf 


























Q» 


























Q 



(12) 



with P e rN+1xn+i > o an( i q0 — diag(qf,.. . ,qfr) where qf are positive scalars for 
all i = {1, . . . ,./V} and for = {/,fe,0} (see [ 15 1 for a simpler case). 

Then, it remains to test the first condition 0. Since this inequality does not depend 



on delays, the derived condition is said to be Independent Of Delays (IOD). Conse- 
quently, this latter criterion provides state feedback gains that stabilize the system for 
all possible values of delays. It thus appears that this method is very conservative and 
it would be interesting to have a condition depending on delays. 

We aim now at deriving a Delay Dependent result ( i.e. the well known DD ap- 
proach which ensures the stability for all values of the delay between zero and an 
upper bound) with the same methodology. To do so note that the results were delay 
independent because operators e~^' s , when s G C + , can only be characterized as un- 
certainties norm bounded by 1 . To get delay dependent results it is therefore needed to 
have characteristics that depend on upper bounds of delays. This can be done noting 
that for all s G C + and a given delay h G [0 h] one has — e~ hs )\ < h and this 

operator is such that V(s) =s -1 (l — e~ hs )X(s) where V(s) and X(s) are the Laplace 
transforms respectively of v(t) — x(t)—x(t — h) andi(f). Introducing this new operator 

for each delay T,, zf and zf, i = {1,... ,N} leads to write the delay dependent stability 
problem of (0 as a well-posedness problem of the system in Figure|5]with 
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where — Aj 
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5t z> (t), W2{t) = b(t) — b r '' (f), w^{t) = x{t) —x r (t) and with the augmented uncertain 
operator 
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where ^ = diag( l ~ e . 1 , . . . , 1-e N ), = {f,b,®}. Delay operators are thus 
isolated as well as operators ^ ensuring a better bound on each delays (delay depen- 
dent case, see lfl5l ). Expressing the covering set on every block of V, a conservative 
choice of separator satisfying the second inequality © of Theorem[T|is 
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where P G R N + lxN+1 > and are positive scalars for all z" = {1, . . . ,N} and for 
= {f,b,®}. Since, the inequality © is satisfied by definition of the operator bounds 
of the uncertain matrix V, it remains to verify the first one (|7). After some algebraic 
manipulations, it can be shown that this latter inequality can be expressed as 
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This latter condition gives the following theorem: 

Theorem 2 For given scalars T,-, l\ and zf for i = {1, ...,N}, if there exists a N + 1 x 
N +1 positive definite matrix P and N xN diagonal positive matrices Q^, Q b k , with 
k = {0, 1} and K\, K 2 such that the inequality rf77l ) is satisfied, then the system ([6j is 
stable. 



The state feedback gains Ki and K 2 are thus derived solving the inequality ( fTTT i of 
Theorem[2] Regarding the synthesis problem, since K\ and K 2 are decision variables, 



condition ( fTTI i is bilinear and a global optimal solution cannot be found. Nevertheless, 
the feasibility problem can still be tested to provide a suboptimal solution: 

> using a BMI solver as penbmi [23 1. 

> using a relaxation algorithm lF30l : 

• step 0. Initialization: K\ = K{ , K2 = A^. 

• step 1. Run LMI computation (inequality (fTTb with fixed KuKi) backup 

Po = P,Qi = QuQi = Q f v 

• step 2. Set P = P , gi = Q lo , Q,{ = Q f l(j and K u K 2 are free, run LMI 
computation. 

• step 3. If condition feasible: stop algorithm. Otherwise: return to step 

It is worthy to note that the state feedback gains K\ and K2 is easily and routinely 
derived solving the matrix inequality ST% while many AQM such RED are well known 
to be difficult to tune as it has been stated in [ 10], |6). 

4 NS-2 SIMULATIONS 

In this section, we perform simulations with the network simulator NS-2 [11] (release 
2.30) to validate the exposed theory. Throughout this part, the efficiency of the pro- 
posed mechanism is evaluated and compared to few existing AQM. Consider the nu- 
merical example of the Figure [6] So, the objective is to regulate the queue length of 
the router to a desired level bo — 100 packets while the maximal buffer size is set to 
400 packets. Propagation times are as illustrated on Figure [6] The link bandwidth is 
fixed to 10Mbps, that is 2500 packet/s considering packet size of 500 bytes. Hence, 
at the equilibrium the queueing delay is equal to 40ms. Each of the three sources uses 
TCP/Reno and establishes 10 connections generating long lived TCP flows (like FTP 
connections). Upon these latter specifications, the equilibrium point (01 is derived: 
bo = lOOpkt, Ti = 150m.s, T2 = 250m.?, T3 = 350ms, x\ Q —X2 Q =*3 = 83.33pkt/s 
(rate for each connections of the three sources) and po — 10~ 3 [9.508 3.444 1.760]'. 

Remark 2 It is worthy to note that the second equation in (0 enables to choose arbi- 
trarily the rate assigned to each sources. This latter option allows us to make a service 
differentiation between senders. In the previous example, we choose to assign the same 
sending rate for all sources (and for each connections) ensuring then fairness. 
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Figure 6: Network topology: an example 



The interconnected system of the form © modeling a such network configuration is 
then written as 
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Then, we have to find matrices K\ and K 2 such that the feedback system ( TT9l > is sta- 
ble and the regulation around the equilibrium point is ensured. Applying Theorem [2] 
exposed in section[3] two stabilizing matrix gains 
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can be found. Considering the network of Figure |6l we have simulated the conges- 
tion phenomenon at a router applying the drop tail mechanism and different AQM. 
Effect of these latter dropping strategies on the queue length have been evaluated and 
are illustrated on Figure|7] Table|2]presents additional characteristics of the results. As 
expected, the drop tail mechanism maintains the queue size close to the buffer overflow 
(maximal buffer size: 4-QQpkt) involving many uncontrolled dropped packets. Futher- 
more, a such large queue size implies a large queueing delay and also large oscillations 
providing an important delay jitter (see Table|2|. 

In order to maintain a controlled (and desired) queueing delay with a low jitter, the 
queue length at the router should be regulated. This issue is tackled with the use of 
AQM (adjustments of the different setting parameters are shown in tableQ}. On Figure 



Table 1 : Adjustment of parameter setting of each AQM 



RED 


m/n r /,=50,max ; / 1 =300,wg=5.99e-06,majCp=0.1,/ s =160Hz 


REM 


7=0.003, 4>=1.001,g re/ =100pkt 


PI 


a=1.483e-05,b=1.479e-05,4 re/ =100pkt,/ 4 .=160Hz 


SF 


gains K\ and K2 d20li. equilibrium point (0 



[7] control performances of AQM can be measured by two observations: the transient 
performance (in particular the speed of response) and the steady state error control. It 
can be observed that the state feedback (SF) J20l ensures an efficient control since the 
queue length matches its equilibrium faster than other cases. Secondly, SF provides a 
better regulation causing less oscillations and good precision. These characteristics can 
be verified in Table [2] which analyses each response from Figure [7j In the simulation, 
AQM was designed to regulate queue size at lOQpkt (equilibrium) avoiding severe con- 
gestion and ensuring then a stable queueing delay of 40ms. First, in Table |2] the mean 
(and average queueing delay since the queueing delay is expressed by b(t)/C) shows 
the accuracy of each AQM according the desired prescribed queue length. Next, the 
standard deviation (and average delay jitter) shows the ability of each AQM to main- 
tain the queue length (and queueing delay) close to the desired equilibrium providing 
then an efficient regulation. Note that REM has the lowest queueing delay, however 
the objective is to guarantee the queue length stability inducing then a queueing delay 
equals to 40ms. If a lower queueing delay is required, one just has to change the equi- 
librium point (reducing the desired queue length). 

Besides, the stability of the congestion phenomenon keeping a stable queue length 
(and thus a stable queueing delay), allows to control the RTT (T, for / = {1, ...,N}) for 
all sources to a desired value with low variations (see Figure[8]). Thanks to the efficient 
regulation applied by SF, a QoS in terms of RTT and delay jitter is hence guaranteed. 
It provides thus an interesting feature which is relevant for streaming and real-time ap- 
plications. Although RED performs a good regulation on the queue length and the RTT 
at the steady state, its response time is very slow which makes RED inefficient against 
short-lived traffic perturbations 1 1 1. 

Table [3] presents statistics related to the packet arrival rates of each user when dif- 
ferent AQM are implemented at the router and bears out the accuracy and the control 
efficiency of the proposed SF. The prescribed equilibrium rate for each connection (ac- 
cording to (0) that establishes fairness is x\ — X2 = xj, = 83.33pkt /s. As it can be 
seen, only SF is able to keep arrival rates comparatively close to the equilibrium value. 

Futhermore, based on the Jain's fairness index — , 'V 1191 (the more the index is 

(nZxf) 

close to 1, the more the distribution of the resources is fair), we observe that SF applies 
a fair strategy. 

5 CONCLUSION 

In this paper the design of an AQM for congeston control of a single router has been 
presented. The considered topology consists in several TCP sources sending long- 
lived flows through a router to their respective receivers. To supply the TCP congestion 
control mechanism, an AQM must be implemented to the router. Based on a modified 
mathematical model of the protocol behavior, a such AQM has been developed with 
control theory tools. Indeed, in a time delay system framework, a control law has been 
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Figure 7: Evolution of the queue length b(t ) (pkt): the desired size is lOQpkts 



Table 2: Some statistics on the queue length for different AQM 
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REM 
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84 
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70.7 


35.1 


23.3 


Average 
queueing delay (ms) 


127 


41.5 


37.9 
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40.9 


Average 
delay jitter(ms) 


33.6 
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28.3 


14 
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Table 3: Some statistics on arrival rates for different AQM 
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Figure 8: Evolution of the RTT of connections from source 3 (ms): the expected value 
is 350ms 



proposed and then the stability analysis of the feedback system has been performed. 
Consequently, the regulation of flows and the queue size of at the router is ensured. At 
last, a numerical example and simulations have shown the effectiveness of the proposed 
methodology. 
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